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In the Claims : 

Please amend claims 1, 1, 22, 24, 39, 44, 53, 56, 59, 63, 66 and 68, and please 
cancel claims 64, 67 and 69, as indicated below. 

1. (Currently amended) A method of sending messages a messag e in an 
interconnection fabric, wherein the interconnection fabric couples together a plurality of 
nodes, wherein each node of the plurality of nodes comprises a plurality of input ports 
and a plurality of output ports, comprising: 

for each of a plurality of messages: 

id e ntifying dynamically selecting a route in the interconnection fabric 
from among a plurality of independent routes for sending the 
message from a sending node to a destination node, wherein said 
id e ntifying dynamically selecting a route comprises sel e cting 
identifying a routing directiye for the selected one of the from a 
routing table comprising a plurality of independent routes from the 
sending node to the destination node; 

wherein said dynamically selecting a route comprises selecting different 
ones of the independent routes from the sending node to the 
destination node for at least two of the messages; 

encoding the routing directive in the message, wherein the routing 
directive describes the route and comprises at least one segment, 
wherein each segment comprises a direction component and a 
distance component; 

sending the message on one of the output ports of the sending node; 
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receiving the message on one of the input ports of a first node connected 
to the output port of the sending node; 

decrementing the distance component for a current segment of the routing 
directive; 

selecting one of the output ports of the first node according to the current 
segment of the routing directive in the message; and 

sending the message on the selected one of the output ports of the first 
node. 

2. (Currently amended) The method as recited in claim 1, wherein said selecting 
one of the output ports comprises: 

if, after said decrementing, the distance component for the current segment is 
greater than zero, selecting the output port corresponding to a same 
routing direction in which the message was traveling when received; and 

if, after said decrementing, the distance component for the current segment is 
zero, selecting the output port corresponding to the direction component of 
the current segment. 

3. (Original) The method as recited in claim 2, wherein if, after said 
decrementing, the distance component for the current segment is zero, and the output port 
is selected according to the direction component of the current segment, the method 
fiirther comprises removing the current segment firom the routing directive so that a next 
segment becomes the current segment when the message is sent on the selected output 
port. 
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4. (Original) The method as recited in claim 3, wherein the routing directive 
further comprises a pointer to the current segment, and wherein said removing the current 
segment comprises moving the pointer to the next segment. 

5. (Original) The method as recited in claim 1, further comprising: 
a subsequent node receiving the message; 

the subsequent node decrementing the distance component for the current 
segment of the routing directive; 

wherein after said decrementing: 

if the distance component for the current segment is greater than zero, the 
subsequent node selecting the output port corresponding to a same 
routing direction in which the message was traveling when 
received; and 

if the distance component for the current segment is zero, the subsequent 
node selecting a port corresponding to the direction component of 
the current segment. 

6. (Original) The method as recited in claim 5, wherein the subsequent node 
selecting a port corresponding to the direction component comprises: 

selecting the corresponding output port if the direction component for the current 
segment specifies a routing direction; and 

selecting a device port if the direction component for the current segment 
specifies that the subsequent node is the destination for the message. 
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7.-8. (Canceled) 

9. (Original) The method as recited in claim 1 wherein the interconnection fabric 
is a torus interconnection fabric. 

10. (Original) The method as recited in claim 1, further comprising: 

identifying a return route from the destination node to the sending node; and 

encoding a return routing directive in the message, wherein the return routing 
directive describes the retum route and comprises at least one segment, 
wherein each segment comprises a direction component and a distance 
component. 

11. (Original) The method as recited in claim 10, further comprising calculating 
the retum routing directive. 

12. (Original) The method as recited in claim 11, wherein the interconnection 
fabric is bi-directional, and wherein calculating the retum routing directive comprises 
reversing the routing directive. 

13. (Original) The method as recited in claim 1, further comprising 
incrementally encoding a retum routing directive in the message, wherein the retum 
routing directive describes a retum route from the destination node to the sending node 
and comprises at least one segment, and wherein each segment comprises a direction 
component and a distance component. 

14. (Original) The method as recited in claim 13, wherein incrementally 
encoding comprises: 
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incrementing the distance component for a current segment of the retum routing 
directive; 

wherein if, after said decrementing, the distance component for the current 
segment of the routing directive is zero, the method further comprises 
modifying the direction component of a current segment of the retum 
routing directive and adding a new segment to the retum routing directive 
so that the new segment becomes the current segment of the retum routing 
directive when the message is sent on the selected output port. 

15. (Original) The method as recited in claim 14, wherein the retum routing 
directive fiirther comprises a pointer to the current segment, wherein adding a new 
segment to the retum routing directive further comprises moving the pointer to the new 
segment. 

16. (Original) The method as recited in claim 1 wherein a first number of 
segments of a first routing directive differs from a second mxmber of segments of a 
second routing directive. 

17. (Original) The method as recited in claim 3 further comprising a subsequent 
node receiving the message and, if all of the segments of the routing directive have been 
removed, the subsequent node identifying itself as the destination node and selecting a 
device port. 

18. (Original) The method as recited in claim 1, wherein each direction 
component comprises a direction relative to a routing direction the message was traveling 
in when received. 

19. (Original) The method as recited in claim 1, wherein each direction 
component comprises an identifier of one of the output ports of one of the nodes. 
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20. (Original) The method as recited in claim 1, wherein the destination node is 
configured to communicate with a storage device. 

21. (Original) The method as recited in claim 20, wherein the storage device 
comprises a disk drive. 

22. (Currently amended) A node, comprising: 
a routing unit; 

a plurality of input ports; and 
a plurality of output ports; 

wherein the node is configured to be connected to an interconnection fabric, 
wherein the interconnection fabric is configured to connect the node to a 
plurality of nodes; 

wherein the routing unit is configured to receive a message being sent along a 
route fi-om a sending node to a destination node in the interconnection 
fabric; 

wherein the routing unit is further configured to receive a routing directive 
encoded in the message, wherein the routing directive describes the route 
and comprises at least one segment, and wherein a segment comprises a 
direction component and a distance component; 

wherein the node is configured to receive the message on one of the input ports 
when the node is not the sending node, wherein the node is further 
configured to decrement the distance component of a current segment of 
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the routing directive and to select one of the output ports according to the 
current segment; 

wherein , when the node is the sending node, the routing unit node is further 
configured to dynamically select a id e ntify th e route from among a 
plurality of independent routes from the sending node to the destination 
node, and wherein the node is configured to encode the routing directive 
for the dynamically selected route in a message in the messag e wh e n th e 
nod e is th e s e nding nod e , wherein th e routing unit is configured to id e ntify 
the rout e by s e lecting th e routing dir e ctiv e from a routing tabl e comprising 
a plurality of ind e pendent rout e s , and wherein the node is configured to 
send the message on one of the output ports; 

wherein for at least two messages, the node is further configured to dynamically 
select different ones of the independent routes from the sending node to 
the destination node when the node is the sending node . 

23. (Canceled) 

24. (Currently amended) The node as recited in claim 22, wherein the node is 
configured to communicate with a device on a device port, wherein the device is 
configured to select a route, encode a routing directive in the message and communicate 
fee a message to the node on the device port when the node is the sending node. 

25. (Original) The node as recited in claim 24, wherein the node is further 
configured to select one of the output ports according to the current segment. 

26. (Original) The node as recited in claim 22, wherein the node is configured to 

select: 
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one of the output ports corresponding to a same routing direction in which the 
message was traveUng when received if, after said decrementing, the 
distance component for the current segment is greater than zero; and 

one of the output ports corresponding to the direction component of the current 
segment if, after said decrementing, the distance component for the current 
segment is zero. 

27. (Original) The node as recited in claim 26, wherein the node is fiirther 
configured to remove the current segment from the routing directive if, after said 
decrementing, the distance component for the current segment is zero, and the wherein 
the node is configured to select the output port according to the direction component of 
the current segment, so that a next segment becomes the current segment when the 
message is sent on the selected output port. 

28. (Original) The node as recited in claim 27, wherein the routing directive 
fiirther comprises a pointer to the current segment, and wherein said being configured to 
remove the current segment comprises being configured to move the pointer to the next 
segment. 

29. (Original) The node as recited in claim 22, wherein the node is configure to 

select: 

one of the output ports corresponding to a same routing direction in which the 
message was traveling when received if, after said decrementing, the 
distance component for the current segment is greater than zero; 

one of the output ports corresponding to the direction component of the current 
segment if, after said decrementing, the distance component for the current 
segment is zero, and if the direction component for the current segment 
does not identify that the node is the destination node; and 
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a device port if, after said decrementing, the distance component for the current 
segment is zero and if the direction component for the current segment 
identifies that the node is the destination node. 

30.-31. (Canceled) 

32. (Original) The node as recited in claim 22, wherein the interconnection 
fabric comprises a torus interconnection fabric. 

33. (Original) The node as recited in claim 22, wherein, if the node is the 
sending node, the routing unit is further configured to identify a return route fi-om the 
destination node to the sending node and to encode a return routing directive in the 
message, wherein the retum routing directive describes the return route and comprises at 
least one segment, wherein each segment comprises a direction component and a distance 
component. 

34. (Original) The node as recited in claim 33, wherein, if the node is the 
sending node, the routing unit is fiirther configured to calculate the retum routing 
directive. 

35. (Original) The node as recited in claim 34, wherein the interconnection 
fabric is bi-directional, and wherein calculating the retum routing directive comprises 
reversing the routing directive. 

36. (Original) The node as recited in claim 22, wherein the node is configiu-ed to 
communicate with a RAID controller. 

37. (Original) The node as recited in claim 22, wherein the node is configured to 
communicate with a mass storage device. 
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38. (Original) The node as recited in claim 37, wherein the mass storage device 
is a disk drive. 

39. (Cxirrently amended) A device, comprising: 

an interface configured to communicate with a source node in an interconnection 
fabric, wherein the interconnection fabric comprises a plurality of routes 
between the source node and a destination node; and 

a controller configured to provide a first routing directive describing a first route 
fi"om the source node to the destination node, wherein the routing directive 
comprises at least one segment, wherein each segment comprises a 
distance component and a direction component, wherein the distance 
component is configured to be decremented by a receiving node; 

wherein the controller is further configured to encode the first routing directive in 
a message, and to communicate the message to the source node to be sent 
on the interconnection fabric to the destination node; and 

wherein the controller is fiirther configured to maintain a routing table comprising 
a plurality of independent routes firom the source node to the destination 
node, and wherein the controller is fiirther configured to dynamically 
select the first routing directive fi^om the routing table when 
communicating the message to the source node to be sent on the 
interconnection fabric to the destination node . 

40. (Original) The device of claim 39, wherein said controller comprises a RAID 
controller. 

41. (Original) The device of claim 39, wherein the controller comprises a host 
interface configured to communicate with a host computer. 
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42. (Original) The device of claim 39, wherein the controller comprises a disk 
storage device controller. 

43. (Canceled) 

44. (Currently amended) The device of claim 4^ 39, wherein the routing table 
further comprises a second routing directive describing a second route from the source 
node to the destination node. 

45. (Original) The device of claim 44, wherein the second routing directive 
comprises a different number of segments than the first routing directive. 

46. (Original) The device of claim 39, wherein the controller is further 
configured to calculate the first routing directive. 

47. (Original) The device of claim 39, wherein the controller is further 
configured to provide a return routing directive describing a return route from the 
destination node to the source node, and wherein the controller is further configured to 
encode the return routing directive in the message. 

48. (Original) The device of claim 47, wherein the controller is further 
configured to select the return routing directive from a routing table. 

49. (Original) The device of claim 47, wherein the controller is further 
configured to calculate the retum routing directive from the first routing directive. 

50. (Original) The device of claim 39, wherein the controller is further 
configured to encode a retum routing directive describing a retum route from the 
destination node to the source node in the message, and wherein the retum routing 
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directive is configured to be incrementally added to as the message is routed to the 
destination node. 

51. (Original) The device of claim 50, wherein the return routing directive is 
further configured to be used to return an error message to the source node if a routing 
error is encountered. 

52. (Original) The device of claim 51, wherein the controller is further 
configured to use the incrementally created return routing directive to locate the routing 
error if an error message is returned, wherein the incrementally created return routing 
directive indicates a last node that successfully received the message. 

53. (Currently amended) A method of sending a message in an interconnection 
fabric, wherein the interconnection fabric couples together a plurality of nodes, wherein 
each node of the plurality of nodes comprises a plurality of input ports and a plurality of 
output ports, comprising: 

identifying a route in the intercoimection fabric for sending the message from a 
sending node to a destination node; 

encoding a routing directive in the message, wherein the routing directive 
describes the route and comprises at least one segment, wherein each 
segment comprises a direction component and a distance component; 

identifying a return route from the destination node to the sending node; 

encoding a return routing directive in the message, wherein the return routing 
directive describes the return route and comprises at least one segment, 
wherein each segment comprises a direction component and a distance 
component; 
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sending the message on one of the output ports of the sending nod e, wherein the 
message includes both the routing directive and the return routing 
directive when sent from the initial sending node : 

receiving the message on one of the input ports of a first node connected to the 
output port of the sending node; 

decrementing the distance component for a current segment of the routing 
directive; 

selecting one of the output ports of the first node according to the current segment 
of the routing directive in the message; and 

sending the message on the selected one of the output ports of the first node. 

54. (Previously presented) The method as recited in claim 53, further comprising 
calculating the retum routing directive. 

55. (Previously presented) The method as recited in claim 54, wherein the 
interconnection fabric is bi-directional, and wherein calculating the return routing 
directive comprises reversing the routing directive. 

56. (Currently amended) A node, comprising: 
a routing unit; 

a plurality of input ports; and 
a plurality of output ports; 
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wherein the node is configured to be connected to an interconnection fabric, 
wherein the interconnection fabric is configured to connect the node to a 
plurahty of nodes; 

wherein the routing unit is configured to receive a message being sent along a 
route from a sending node to a destination node in the interconnection 
fabric; 

wherein the routing unit is further configured to receive a routing directive 
encoded in the message, wherein the routing directive describes the route 
and comprises at least one segment, and wherein a segment comprises a 
direction component and a distance component; 

wherein the node is configured to receive the message on one of the input ports 
when the node is not the sending node, wherein the node is fiirther 
configured to decrement the distance component of a current segment of 
the routing directive and to select one of the output ports according to the 
current segment; and 

wherein, when the node is the sending node, the routing unit is further configured 
to identify a return route from the destination node to the sending node 
and to encode a return routing directive in the message, wherein the return 
routing directive describes the return route and comprises at least one 
segment, wherein each segment comprises a direction component and a 
distance componen t, wherein the message includes both the routing 
directive and the retum routing directive when sent from the initial 
sending node . 

57. (Previously presented) The node as recited in claim 56, wherein, when the 
node is the sending node, the routing unit is further configured to calculate the retum 
routing directive. 
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58. (Previously presented) The node as recited in claim 57, wherein the 
interconnection fabric is bi-directional, and wherein calculating the return routing 
directive comprises reversing the routing directive. 

59. (Currently amended) A device, comprising: 

an interface configured to communicate with a source node in an interconnection 
fabric, wherein the interconnection fabric comprises a plurality of routes 
between the source node and a destination node; and 

a controller configured to provide a first routing directive describing a first route 
from the source node to the destination node, wherein the routing directive 
comprises at least one segment, wherein each segment comprises a 
distance component and a direction component, wherein the distance 
component is configured to be decremented by a receiving node; 

wherein the controller is fiirther configured to encode the first routing directive in 
a message, and to commimicate the message to the source node to be sent 
on the interconnection fabric to the destination node; and 

wherein the controller is fiirther configured to provide a retum routing directive 
describing a retum route from the destination node to the source node, 
wherein the retum routing directive comprises at least one segment, 
wherein each segment comprises a direction component and a distance 
component; and 

wherein the controller is further configured to encode the retum routing directive 
in the messag e, wherein the message includes both the routing directive 
and the retum routing directive when sent from the initial sending node . 
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60. (Previously presented) The device of claim 59, wherein the controller is 
further configured to select the return routing directive from a routing table. 

61. (Previously presented) The device of claim 59, wherein the controller is 
further configured to calculate the retum routing directive from the first routing directive. 

62. (Previously presented) The device of claim 59, wherein the retum routing 
directive is further configured to be used to return an error message to the source node if 
a routing error is encountered. 

63. (Currently amended) A method of sending a message in an interconnection 
fabric, wherein the interconnection fabric couples together a plurality of nodes, wherein 
each node of the plurality of nodes comprises a plurality of input ports and a plurality of 
output ports, comprising: 

identifying a route in the interconnection fabric for sending the message from a 
sending node to a destination node; 

encoding a routing directive in the message, wherein the routing directive 
describes the route and comprises at least one segment, wherein each 
segment comprises a direction component and a distance component; 

sending the message on one of the output ports of the sending node; 

receiving the message on one of the input ports of a first node connected to the 
output port of the sending node; 

decrementing the distance component for a current segment of the routing 
directive; 
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selecting one of the output ports of the first node according to the current segment 
of the routing directive in the message; 

sending the message on the selected one of the output ports of the first node; and 

incrementally encoding a return routing directive in the message, wherein the 
return routing directive describes a return route fi"om the destination node 
to the sending node and comprises at least one segment, and wherein each 
segment comprises a direction component and a distance component; 

wherein said incrementally encoding comprises: 

incrementing the distance component for a current segment of the retum 
routing directive: 

wherein if after said decrementing, the distance component for the current 
segment of the routing directive is zero, the method fiirther 
comprises modifying the direction component of a current segment 
of the retum routing directive and adding a new segment to the 
retum routing directive so that the new segment becomes the 
current segment of the retum routing directive when the message is 
sent on the selected output port . 

64. (Canceled) 

65. (Previously presented) The method as recited in claim 63, wherein the retum 
routing directive fiirther comprises a pointer to the current segment, wherein adding a 
new segment to the retum routing directive fiirther comprises moving the pointer to the 
new segment. 

66. (Currently amended) A node, comprising: 
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a routing unit; 

a plurality of input ports; and 
a plurality of output ports; 

wherein the node is configured to be connected to an interconnection fabric, 
wherein the interconnection fabric is configured to connect the node to a 
plurality of nodes; 

wherein the routing unit is configured to receive a message being sent along a 
route fi'om a sending node to a destination node in the interconnection 
fabric; 

wherein the routing unit is further configured to receive a routing directive 
encoded in the message, wherein the routing directive describes the route 
and comprises at least one segment, and wherein a segment comprises a 
direction component and a distance component; 

wherein the node is configured to receive the message on one of the input ports 
when the node is not the sending node, wherein the node is further 
configured to decrement the distance component of a current segment of 
the routing directive and to select one of the output ports according to the 
current segment; and 

wherein the routing unit is further configured to incrementally encode a return 
routing directive in the message, wherein the retum routing directive 
describes a retum route from the destination node to the sending node and 
comprises at least one segment, and wherein each segment comprises a 
direction component and a distance component , wherein in incrementallv 
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encoding a return routing directive, the routing unit is further configured 
to: 

increment the distance component for a current segment of the return routing 
directive: 

wherein if after said decrementing, the distance component for the current 
segment of the routing directive is zero, the routing imit is fiirther 
configured modify the direction component of a current segment of the 
retum routing directive and add a new segment to the return routing 
directive so that the new segment becomes the current segment of the 
retum routing directive when the message is sent on the selected output 
port . 

67. (Canceled) 

68. (Currently amended) A device, comprising: 

an interface configured to communicate with a source node in an interconnection 
fabric, wherein the interconnection fabric comprises a plurality of routes 
between the source node and a destination node; and 

a controller configured to provide a first routing directive describing a first route 
fi-om the source node to the destination node, wherein the routing directive 
comprises at least one segment, wherein each segment comprises a 
distance component and a direction component, wherein the distance 
component is configured to be decremented by a receiving node; 

wherein the controller is fiulher configured to encode the first routing directive in 
a message, and to communicate the message to the source node to be sent 
on the interconnection fabric to the destination node; and 
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wherein the controller is further configured to incrementally encode a return 
routing directive describing a return route firom the destination node to the 
source node in the message, wherein the return routing directive describes 
a return route fi-om the destination node to the sending node and comprises 
at least one segment, and wherein each segment comprises a direction 
component and a distance component, and wherein the retum routing 
directive is configured to be incrementally added to as the message is 
routed to the destination node , wherein the retum routing directive is 
fiirther configured to be used to retum an error message to the source node 
if a routing error is encountered , 

69, (Canceled) 



70. (Previously presented) The device of claim 68, wherein the controller is 
further configured to use the incrementally created retum routing directive to locate the 
routing error if an error message is retumed, wherein the incrementally created retum 
routing directive indicates a last node that successfully received the message. 

71. (Previously presented) A storage system, comprising a plurality of nodes 
interconnected by an interconnection fabric; 

wherein different ones of said plurality of nodes perform different functions in the 
storage system; 

wherein each one of a first portion of said plurality of nodes is a storage node 
comprising at least one mass storage device; 

wherein each one of a second portion of said plurality of nodes is a host interface 
node configured to provide an interface for the storage system to a host 
computer; 
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wherein each node of the pluraUty of nodes comprises: 
a routing unit; 

a plurahty of input ports; and 

a plurahty of output ports; 

wherein the routing unit of each node is configured to receive a message being 
sent along a route from a sending node to a destination node in the 
interconnection fabric; 

wherein the routing unit of each node is further configured to receive a routing 
directive encoded in the message, wherein the routing directive describes 
the route and comprises at least one segment, and wherein a segment 
comprises a direction component and a distance component; and 

wherein each node is configured to receive the message on one of the input ports 
when the node is not the sending node, wherein the node is further 
configured to decrement the distance component of a current segment of 
the routing directive and to select one of the output ports according to the 
current segment. 



09/755,479 (5 1 8 1 -68300/P5074) 



22 



Meyertons, Hood, Kivlin, Kowert & Goetzel, P.C. 



